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BACKGROUND OF THE INVENTION 

Field Of The Invention 

[0001] The present invention relates to control of a computer system. Specifically, 
the invention relates to apparatus, methods, and systems for improved feedback regarding 
pointing device events and processes. 

Description Of The Related Art 

[0002] Computer systems have become increasingly interactive with computer users. 
The advent of the personal computer provided a dedicated computer, keyboard, and monitor 
to nearly every computer user. Further developments in operating systems such as graphical 
user interfaces and multimedia support have resulted in a highly interactive experience for 
computer users. Pointing devices such as mice, light pens, digitizing tablets, trackballs, 
touch pads, and touch screens have provided the user with additional control and 
interactivity. In the future, data gloves and gesture recognition are expected to further 
improve the ability of the user to point to objects or commands that the user wishes to 
process. 

[0003] In addition to the accessibility and control provided by input devices and 
methods, feedback is a critical element of the modern computing experience. Various modes 
of feedback such as visual and audio feedback guide the user and improve the efficiency of 
the computing experience. The rich quality of feedback available with multimedia 
computing devices and systems has significantly improved the interactivity and usefulness of 
the computing experience. 

[0004] In addition to application or task specific information, computers often give 
feedback regarding the operating state of the computer system. For example, a computer 
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may beep and/or display an error message in response to an error condition. A cursor 
associated with a mouse or other pointing device may change to the shape of a watch or 
hourglass to indicate that the computer is busy with an operation, and processing of further 
input from the pointing device will be delayed until the operation is completed. Warnings 
may be presented to the user to avoid catastrophic conditions or situations. 

[0005] Despite the many forms and methods of feedback currently presented to users, 
methods for providing feedback to users of pointing devices remain woefully inadequate. For 
example, when a computer is busy processing a particular task, the user is not informed as to 
whether the computer is ready to accept additional input from the pointing device. For 
example, a user may click or double-click on a screen element to request that a file be 
opened, or a program be executed. Qften such requests place the computer is in a busy state 
and block further interaction causing the user to repeat the operation. When the computer 
comes out of the busy state, the user may have unwittingly entered a number of redundant 
pointing device events or invoked an undesired task or function. 

[0006] Referring to Figure 1, a representative prior art computer system 100, 
illustrates in further detail the issues related to providing feedback to a user of a pointing 
device. The prior art computer system 1 00 includes a computer 1 1 0, a pointing device 115, 
a pointing device interface module 120, an event buffer 125, an application interface module 
130, and one or more applications 140. The depicted architecture of the prior art computer 
system 100 imposes certain limitations on user interactivity using the pointing device 115. 

[0007] The pointing device 115 facilitates selecting user interface elements and 
inputting spatial data into the computer 1 1 0. The pointing device 1 1 5 may generate pointing 
device events, which are received by the pointing device interface module 120. In the 
depicted example, the pointing device interface module 120 inserts the pointing device 
events into the event buffer 125. The pointing device interface module 120 may also provide 
events from the event buffer 125 to the application interface module 130. In certain 
embodiments, the pointing device interface module 120 is a device driver that interfaces with 
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the hardware associated with the pointing device 115. In the depicted embodiment, the event 
buffer 125 is an intrinsic part of the pointing device interface module 120. 

[0008] The application interface module 130 requests or receives pointing device 
events from the pointing device interface module 120. The application interface module 130 
is typically an operating system process that ensures orderly access to the pointing device 
and any drivers or modules associated therewith. The application interface module 130 
provides pointing device events, or events and information associated therewith, to the 
applications 140. The applications 140 process the events and information provided by the 
application interface module 130 and determine what feedback will be provided to the user. 
Such feedback may involve accessing several layers of software before actual feedback is 
presented to the user. 

[0009] Existing approaches to giving feedback to the user are dependent on the long 
processing chain associated with receiving input events and communicating feedback 
information. If any process in the chain is inaccessible or inoperable, interactivity with the 
user is suspended or halted. Suspending or halting interactivity requires the user to speculate 
as to what is occurring within the computing device or system. 

[0010] Accordingly, what is needed is an improved approach to giving feedback to 
users of pointing devices, such that the user is provided with more information regarding 
pointing device events and processes. Such information would further improve the 
interaction between the computer and the user. 
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BRIEF SUMMARY OF THE INVENTION 

[001 1] The present invention has been developed in response to the present state of 
the art, and in particular, in response to the problems and needs in the art that have not yet 
been fully solved by currently computing devices and systems. Accordingly, the present 
invention has been developed to provide an apparatus, method, and system for providing 
improved interaction to a user of a pointing device that overcome many or all of the above- 
discussed shortcomings in the art. 

[0012] In one aspect of the present invention, an apparatus for providing improved 
interaction to a user of a pointing device includes a pointing device interface module that 
interfaces with a pointing device, an event buffer that receives pointing device events 
generated by a user, and a feedback module that provides feedback to the user regarding 
buffered pointing device events. The feedback module may also receive information and 
provide feedback to the user regarding pointing device events passed to a receiving process. 
The receiving process may be an application process or an operating system process. 

[0013] The feedback provided to the user may occur through a variety of modes 
including audible feedback, visual feedback, and tactile feedback. Examples of visual 
feedback include screen flashes, indicator lights, icons, status bars, dialogs, and modified 
cursors. Examples of audio feedback include beeps, tones, pings, musical chords, sound 
effects, audio recordings, synthesized speech, and the like. Examples of tactile feedback 
include device vibrations, movement, resistance to movement, actuation of a surface, and the 
like. 

[0014] In another aspect of the invention, a method for providing improved 
interaction to a user of a pointing device includes receiving pointing device events initiated 
by a user into a buffer, directing pointing device events from the buffer to a receiving 
process, and providing feedback regarding buffered pointing device events to the user. 

[0015] Certain embodiments of the present invention inventory pointing device 
events in order to collect information useful to the user. For example, the number of 
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buffered events and the type of each buffered event may be assessed and used to provide 
feedback to the user. The collected information may be presented in various forms and 
modes of communication. For example, audible feedback, visual feedback, tactile feedback 
and the like may be used to covey information to the user useful for successful interaction 
with the computer. 

[0016] Configuration options may facilitate selection of preferred means or methods 
of providing feedback to the user. Examples of configuration options include screen flash 
options, indicator light options, cursor color options, cursor shape options, audible sound 
options, status display options, icon options, vibration options, and motion options. 

[001 7] The present invention improves user interaction with computing devices and 
systems. The present invention may be applied to a variety of pointing devices such as mice, 
pens, digitizing tablets, trackballs, touch pads, touch screens, pointing sticks, data gloves, 
and gesture recognizers. These and other features and advantages of the present invention 
will become more fully apparent from the following description and appended claims, or 
may be learned by the practice of the invention as set forth hereinafter. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

In order that the advantages of the invention will be readily understood, a more 
particular description of the invention briefly described above will be rendered by reference 
to specific embodiments that are illustrated in the appended drawings. Understanding that 
these drawings depict only typical embodiments of the invention and are not therefore to be 
considered to be limiting of its scope, the invention will be described and explained with 
additional specificity and detail through the use of the accompanying drawings, in which: 

[0018] Figure 1 is a block diagram illustrating a typical prior art computer system; 

[0019] Figure 2 is a block diagram illustrating a one embodiment of an improved 
interaction computer system in accordance with the present invention; and 

[0020] Figure 3 is a flow chart diagram illustrating one embodiment of a pointing 
device event feedback method of the present invention. 

[002 1] Figure 4 is a schematic diagram illustrating one embodiment of an improved 
interaction computer system in accordance with the present invention. 
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DETAILED DESCRIPTION OF THE INVENTION 

[0022] It will be readily understood that the components of the present invention, as 
generally described and illustrated in the Figures herein, may be arranged and designed in a 
wide variety of different configurations. Thus, the following more detailed description of the 
embodiments of the apparatus, method, and system of the present invention, as represented 
in Figures 1 through 4, is not intended to limit the scope of the invention, as claimed, but is 
merely representative of selected embodiments of the invention. 

[0023] Many of the functional units described in this specification have been labeled 
as modules, in order to more particularly emphasize their implementation independence. For 
example, a module may be implemented as a hardware circuit comprising custom VLSI 
circuits or gate arrays, off-the-shelf semiconductors such as logic chips, transistors, or other 
discrete components. A module may also be implemented in programmable hardware 
devices such as field programmable gate arrays, programmable array logic, programmable 
logic devices or the like. 

[0024] Modules may also be implemented in software for execution by various types 
of processors. An identified module of executable code may, for instance, comprise one or 
more physical or logical blocks of computer instructions which may, for instance, be 
organized as an object, procedure, or function. Nevertheless, the executables of an identified 
module need not be physically located together, but may comprise disparate instructions 
stored in different locations which, when joined logically together, comprise the module and 
achieve the stated purpose for the module. 

[0025] Indeed, a module of executable code could be a single instruction, or many 
instructions, and may even be distributed over several different code segments, among 
different programs, and across several memory devices. Similarly, operational data may be 
identified and illustrated herein within modules, and may be embodied in any suitable form 
and organized within any suitable type of data structure. The operational data may be 
collected as a single data set, or may be distributed over different locations including over 
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different storage devices, and may exist, at least partially, merely as electronic signals on a 
system or network. 

[0026] Reference throughout this specification to "one embodiment" or "an 
embodiment" means that a particular feature, structure, or characteristic described in 
connection with the embodiment is included in at least one embodiment of the present 
invention. Thus, appearances of the phrases "in one embodiment" or "in an embodiment" in 
various places throughout this specification are not necessarily all referring to the same 
embodiment and the described features, structures, or characteristics may be combined in 
any suitable manner in one or more embodiments. 

[0027] Figure 2 is a flow chart diagram illustrating one embodiment of an improved 
interaction computer 200 of the present invention. The improved interaction computer 200 
includes a computer 210, a pointing device 215, a pointing device interface module 220, an 
event buffer 225, a feedback module 230, an application interface module 240, and one or 
more applications 250. The improved interaction computer 200 provides improved 
interaction to a user of a pointing device, or the like. The improved interaction computing 
system 200 addresses the previously mentioned limitations of the prior art. 

[0028] The pointing device 215 facilitates selecting user interface elements and 
inputting spatial data into the computer 210. Pointing devices may be used with graphical 
user interfaces to enable the user to control and provide data to the computer. For example, 
pointing devices may facilitate expression of physical gestures such as "point," "click," and 
"drag," which result in predictable actions by the computer. Movements of the pointing 
device may be emulated on the computer screen by a cursor. Representative pointing 
devices include a mouse, a pen, a digitizing tablet, a trackball, a touch pad, a pointing stick, a 
data glove, and a gesture recognizer. 

[0029] The pointing device 215 may generate pointing device events, which are 
directed to the pointing device interface module 220. In the depicted embodiment, the 
pointing device interface module 220 buffers pointing device events in the event buffer 225. 
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The pointing device interface module 220 may also provide events from the event buffer 225 
to the feedback module 230. In the depicted embodiment, the event buffer 225 is an intrinsic 
part of the pointing device interface module 220. In other embodiments, the buffer 225 may 
reside in a location suited to the particular operating system resident on the computer 200. 

[0030] In one embodiment, the pointing device interface module 220 inventories the 
number of buffered events and provides the number of events to the feedback module 230. 
The pointing device interface module 220 may also inventory the type of buffered events and 
provide the inventory data to the feedback module 230. The pointing device interface 
module 220 may be a device driver. 

[0031] The feedback module 230 provides feedback regarding the pointing device 
events, and may also determine the type of feedback that will be provided to the user, based 
on the data provided by the pointing device interface module and configuration options 
which may be set by the user. The feedback module 230 may also coordinate with and 
provide pointing device events to the application interface module 240, which determines 
which of the one or more applications 250 the events should be directed to. In one 
embodiment, the application interface module 240 informs the feedback module when an 
application process has received a particular pointing device event. The feedback module 
may use information provided by both the application interface module 240 and the pointing 
device interface module 220 in order to present a coherent view of pointing device events 
and processes to the user. 

[0032] In one embodiment, the feedback module is a device driver filter that resides 
on the driver level of an operating system. In another embodiment, the feedback module is 
an operating system process that coordinates with multiple device drivers. In another 
embodiment, the feedback module is an application process that provides application 
specific feedback. The depicted embodiment includes the application interface module 240, 
which may not be present in certain embodiments. 
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[0033] Figure 3 is a flow chart diagram illustrating one embodiment of a pointing 
device event feedback method 300 of the present invention. The pointing device event 
feedback method 300 includes a buffer events step 310, an inventory events step 320, a 
provide feedback step 330, and a direct events step 340. The pointing device event feedback 
method may be conducted in conjunction with, or independent of, the pointing device 
interface module 220 and the feedback module 230 of Figure 2. The pointing device event 
feedback method 300 facilitates improved interaction between the computer and the 
computer user. 

[0034] The buffer events step 310 buffers events from the pointing device in an event 
buffer. In one embodiment, the event buffer is a FIFO queue comprising a circular buffer. 
The inventory events step 320 inventories pointing device events buffered in the event 
buffer. In certain embodiments, the inventory consists of a count of the number of events in 
the event buffer. In some embodiments, the inventory consists of a count of the number of 
various types of events in the event buffer. 

[0035] The provide feedback step 330 provides feedback to the user based on the 
results of the inventory events step 320. Embodiments of the present invention may provide 
various types of feedback including visual feedback, audible feedback, and tactile feedback. 
For example, visual feedback may include displaying an icon, status bar, dialog, screen flash, 
or an indicator light, a modified cursor, or the like. The modified cursor may change in 
shape, color, texture, or position, or flash to communicate feedback information. Audible 
feedback may include generating a beep, ping, tone, musical chord, sound effect, or 
synthesized speech. Tactile feedback may include force, pressure, vibration, and motion. 
Certain embodiments enable the user to configure the type of feedback to be provided. 

[0036] The direct events step 340 directs pointing device events to one or more 
receiving processes. In certain embodiments, the receiving process is an application 
program process. In other embodiments, the receiving process is an operating system 
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process. Upon completion of the direct events step 340, the pointing device event feedback 
method ends 350. 

[0037] Figure 4 is a schematic diagram illustrating one embodiment of an improved 
interaction computer system 400 in accordance with the present invention. The improved 
interaction computer system 400 comprises a computer 410, a pointing device 415, an 
indicator light 420, speakers 430a and 430b, and a status bar 440. The depicted embodiment 
may use the indicator light 420 to provide visual feedback, the speakers 430a and 430b to 
provide audible feedback, and the status display 440 to provide visual feedback. In one 
embodiment, the pointing device 4 1 5 is enhanced to provide tactile feedback The feedback is 
in one embodiment generated in accordance with the apparatus and/or method of Figures 2 
and 3. 

[0038] The various elements of the present invention facilitate improved interaction 
with users of computer pointing devices. The present invention may be embodied in other 
specific forms without departing from its spirit or essential characteristics. The described 
embodiments are to be considered in all respects only as illustrative and not restrictive. The 
scope of the invention is, therefore, indicated by the appended claims rather than by the 
foregoing description. All changes which come within the meaning and range of 
equivalency of the claims are to be embraced within their scope. 

What is claimed is: 
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